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Overview 


>  What  is  reliability  ? 

r  Basics  of  reliability  methods  for  repairable  and  non¬ 
rep  air  able  systems 

>  Estimation  of  PDF  of  Time  Between  Failures  (TBF) 
using  limited,  censored  data 

r  System  reliability  and  reliability  allocation 

>  Fleet  Maintenance  Simulation  (FMS)  Tool 

>  Unmanned  ground  vehicle  (UGV)  system  example 
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What  is  Reliability? 

Reliability  at  time  t  is  the  probability  that  the  system 

has  not  failed  before  time  t. 

1 

failure 

1  V 

1 

0 

1  A 

t  T 

time 

R(t)  =  P(T  >  t)  =  \- P{T  <t) 
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Reliability  of  Non-Repairable  Systems 
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From  (1)  and  (2)  we  get : 
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Reliability  of  Non-Repairable  Systems 
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Reliability  Calculation 


All  we  need  for  calculating  the 
reliability  of  a  system  (non-repairable 
or  repairable)  is  the  system  PDF  of 
time  to  failure  (TTF) 


We  use : 

>  Data  to  estimate  the  PDF  of  TTF  for  each  component 

>  Monte  Carlo  simulation  to  estimate  the  PDF  of  TTF 
for  the  system 
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Estimation  of  the  PDF  of  the 
TTF  (TBF)  using  Limited, 
Censored  Data 

Censored  MLE  Approach 
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Limited  Data  /  Notation 


Original  data 
Vehicle#  mileage 


Updated  data 
Vehicle#  mileage 
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Observation  /  Assumption 


d  M, 
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m,=X^  /3(A,B,p,q),  i 

(A  <  Xt  <  B ,  and  p  >  0,  q  >  0) 

f(x,  A,  B,  p,  q)=^(p,q)~'  1 

[x-AY  x{B  -  x] 

r'j 

\b  -  A)p+q  1 ,  (A<  x  <  B,  and  p  >  0,  q  >  0) 

A=  0 

B  =  45,000  miles 
p  =  3,  q  =  5 
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Observation  /  Assumption 

■  Beta  distribution  family  is  used  to  model  TBF. 

Beta  distributed  PDF 


A= 0,  B  =  30000 

f{x,A,B,p,q)=/3{p,qyi  (x  -  A)p~l  (B  -  x)q~l / (B  -  A)p+q~l ,  (A<  x  <  B,  and  p  >  0,  q  >  0) 
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MLE  Approach 


Determines  parameters  (A,  B,  p,  q )  of  “most  likely”  Beta 

distribution  using  available  data. 


Censored  MLE 


#  of  recorded 

failures  #  of  survivals 
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If  Only  MTBF  is  Available 

f(x,A,B,p,q)=^p,qyx{x-Af~x{B-xy~x/{B-A)p+q~l ,  ( A<  x<  B ,  and  p  >  0,  q  >  0) 
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System  Reliability  and 
Reliability  Allocation 
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Comp.  1 


Comp,  n 


System  Reliability 
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System 

TTF 


Histogram  System  Reliability 
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Monte  Carlo 
Simulation 


For  System  : 

00 

MTBF  =  f  R(t)dt 
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Reliability  Allocation 


Specify  system  (vehicle)  reliability 


Optimization 


V 


Determine  required  reliability  of  EACH  component 


This  optimization  problem  DOES  NOT 
have  a  unique  solution 


J 
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Reliability  Allocation 


One  way  to  get  a  unique  solution  is  to  trade-off 
reliability  and  associated  cost 


min  Cost 


n 

—comp 


Target  system 
reliability 


s.  t.  System  Reliability  =  R 


/ 


By  varying  Rl  ,  we  get  the  so  called  “Pareto  Frontier.” 
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-  Reliability 


Reliability  vs  Risk  of  Failure  (Cost) 


We  want  to  maximize  Reliability  and  simultaneously 

minimize  Risk  of  failure  (cost) 


,  Utopia 


Cost 
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Reliability  -  Cost  Pareto  Front  Calculation 
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Reliability-Cost  Relation 


cost  =  cost0  /(MTBF/MTBFo  11  :  For  each  component 

Cost  =  ^  [cost0  e^(MTBF/MTBF°  11  (1  +  failure  counts) 

z‘c=l 

For  system  with  Nc  components 

I 

Unit  Cost 
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Example  :  Fifteen-Component 

System  in  Series 
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Input  Information 


Component 
Number 
Comp  No. 

Baseline  MTBF  in 
hours  (MTBF0) 

Coefficient 
of  Variation 

^ factor 

Baseline 
cost  (Cost0) 

k 

1 

4076 

0.3 

3 

$27,500.00 

1 

2 

15000 

0.3 

3 

$7,000.00 

1 

3 

26510 

0.3 

3 

$3,000.00 

1 

4 

40000 

0.3 

3 

$5,000.00 

1 

5 

18000 

0.3 

3 

$5,000.00 

1 

6 

8000 

0.3 

3 

$500.00 

1 

7 

31809 

0.3 

3 

$22,500.00 

1 

8 

9520 

0.3 

3 

$30,000.00 

1 

9 

9713 

0.3 

3 

$12,500.00 

1 

10 

2330 

0.3 

3 

$20,000.00 

1 

11 

40000 

0.3 

3 

$27,500.00 

1 

12 

8614 

0.3 

3 

$1,000.00 

1 

13 
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0.3 

3 

$30,000.00 

1 

14 

20000 

0.3 

3 

$3,000.00 
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15 
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0.3 
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$15,000.00 

1 
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Histogram  of  System  Failures 
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6641 


Reliability  Comparison  between  Repairable 

and  Non-repairable  System 
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Reliability 


System  Reliability-Cost  Pareto  Front 
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Summary:  Methodology 

>  A  methodology  was  presented  to  : 

■  Calculate  system  reliability  using  limited 
data 

■  Perform  reliability  allocation  (determine 
reliabilities  of  components)  using  optimal 
trade-off  between  reliability  and  cost 

>  The  methodology  was  demonstrated  with  a 
fifteen-component  vehicle  system 
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Fleet  Maintenance  Simulation 

(FMS)  Tool 
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Simulation  and  Optimization  -  FMS  Tool 

•  Developed  jointly  by  TARDEC  (CASSI  Analytics)  and  Oakland  University 

•  Predicts  vehicle  maintenance  over  lifecycle  based  on  component  input  data 


•  Enables  reliability-cost  trade/sensitivity/optimization  studies  for  vehicle  fleets 


Cost 


FMS  Tool  used  to  perform  reliability-cost  trade  study  for 
adding  redundant  motors  and  sensors  to  an  unmanned 
ground  vehicle  (UGV)  manipulator  arm 
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Analysis  Procedure 


1  .Estimate  component  probability  of  failure 
vs  time  or  mileage 

-  Focus  on  cost  and  repair  drivers 

-  Minimum  data:  mean  time  between  failure  (MTBF) 


Time 


2. Run  Monte  Carlo  simulations  to  predict 
fleet  reliability,  availability,  cost 

-  Vehicle  lifetime:  user- specified 

-  Number  of  simulated  vehicles:  user-specified 


it,*  K»m 


Failure  |  Repair 


3  .Perform  trade/sensitivity/optimization 
studies 

-  Tradeoffs  among  configurations,  component 
changes,  maintenance  schedules,  etc. 

-  Sensitivity  to  data  uncertainty,  price  changes,  etc. 

-  Optimization  of  components,  schedules,  etc. 
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Estimation  of  Component  Reliability 


Beta  distribution  family  is  used  to 
model  probability  of  component 
failure  versus  time  or  mileage 

When  maintenance  records  are 
available: 

-  FMS  Tool  processes  raw  data 

For  limited,  censored  data  FMS 

Tool  has  two  options  to  estimate 
the  distribution 

-  Censored  Maximum  Likelihood 
Estimation  (MLE) 

-  Bayesian  updating  approach 
(“enhances”  data  with  expert  opinion) 
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Example:  Unmanned  Ground  Vehicle 

(UGV) 


Focus  on  robotic  arm  design 

For  original  design,  each  joint 
and  the  end  effector  has: 

-  1  motor 

-  1  optical  encoder  (sensor) 

Perform  trade  study  for  adding 
secondary  sensors,  motors 

Use  reliability  @  1000  hours  of 
operation  as  input  data 

-  Motor:  R(1000)  =  0.969 

-  Sensor:  R(1000)  =  0.814 
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Reliability  of  UGV  Arm  -  Original  Design 

Rs  =  (0.969x0.8I4)+  =0.387 


Fault  Tree  for  Original  Design 


• 

J 

joint 

ee 

end  effector 

m 

motor 

s 

sensor 

Figure  4.  Fault  tree  for  four-joint  UGV  manipulator  with  3DOF  and  1D0F  servo  gripper 
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Reliability  for  One  Design  Configuration  with 

Redundant  Components 

Rs  =  Jo.969 x  [l  -  (1  -  0.814)2]j3  }l  -(1  -  0.75 )2 ] x  [l  - (L  -  0.8 14)2 }=  0.741 

' - - - v - - - ^ - — v - ' 

for  jo  inis  1,3,  and  4  for  iomt 2 
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Reliability  vs.  Cost  Trade  Study 


Redundant  components 
provide  higher  system 
reliability,  but. . . 

-  At  what  cost? 

-  Is  it  worth  it? 


Use  FMS  Tool  to 

-  Perform  trade  study 

-  Find  Pareto  frontier 
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Fault  Tree  Model  in  FMS  Tool 
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FMS  Tool  Results:  Original  Design 


Simulation  results 
yield  system 
reliability 
R=0.75 

t=1000  hours 


Close  to 

theoretical  value 
of  0.741 
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System  reliability  and  cost 
@  1000  hours  of  operation 
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Component  Alternatives 


Component  Input  Data 


1 

Comp.  No 

MTBF* 

Cov 

1 

B  factor 

1 

Unit  Costo 

k 

1 

31519 

0.98 

26.09 

$150.00 

1 

-2 

4845 

0.77 

2.8228 

S50.00 

1 

-3 

4845 

0.77 

2.8228 

$50.00 

1 

4 

3476.616 

0.98 

26.09 

$61 .62 

1 

5 

3476.616 

0.98 

26.09 

$61.62 

11 

45 

4845 

0.77 

2.8228 

$50.00 

1 

-7 

4845 

0.77 

2.8228 

$50.00 

1 

8 

31519 

0.98 

26.09 

$150.00 

1 

-9 

4845 

0.77 

2.8228 

$50.00 

1 

-10 

4845 

0.77 

2.8228 

$50.00 

1 

11 

31519 

0.98 

26.09 

$150.00 

1 

-12 

4845 

0.77 

2.8228 

$50.00 

1 

-13 

4845 

0.77 

2.8228 

$50.00 

1 

Component  Input  Data 

Negative  numbers:  components  that  do  not  have  alternatives 
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FMS  Tool 
Results: 
Trade  Study 


Reliability-cost 
Pareto  set  @ 
1000  hours  of 
operation 
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Recent  and  Ongoing  Work 

•  Adding  system  and  fleet  attributes 

-  Weight,  fuel  efficiency/cost 

-  Availability 

•  Enhancing  underlying  models 

-  Different  types  of  failure  modes,  more  probability  distributions 

-  Scheduled  maintenance,  preventive  maintenance 

•  Implementing  state-of-the-art  multi-objective  optimizer 

-  Non-dominated  sorting  genetic  algorithm  II  (NGSA-II) 

-  Multiple  objectives  beyond  cost  and  reliability 

•  Converting  software  framework  from  Excel  to  MATLAB 

-  Improve  computational  performance 

-  Leverage  MATLAB  toolkits 

-  Foster  collaborative  development  (TARDEC,  OU,  SMART  Students) 
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Summary:  FMS  Tool 

•  Fleet  Maintenance  Simulation  (FMS)  Tool  has  been  developed 
to  perform  trade/sensitivity/optimization  studies 

•  FMS  Tool  applied  to  example  UGV  trade  study  for  validation 
and  demonstration  purposes 

•  Software  is  under  active  development  by  TARDEC  and  OU  to 
enhance  capabilities  and  improve  efficiency 
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Q  &  A 
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